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I .  INTRODUCTION 


In  statistical  applications,  it  is  frequently  desired 
to  determine,  with  some  specified  confidence,  whether  a 
random  sample  is  from  a  hypothesized  distribution.  Sim¬ 
ilarly,  it  is  frequently  desirable  to  establish  confidence 
limits  on  the  distribution  function  using  sample  observa¬ 
tions.  There  are  numerous  procedures  which  accomplish 
these  objectives  when  the  sample  is  uncensored.  The 
Kolomogorov-Smirnov  test  is  applicable  to  both  of  these 
objectives  and  has  the  advantages  of  being  distribution 
free  and  simple  to  apply. 

In  situations  wherein  the  data  is  censored  beyond  a 
predetermined  number  of  failures,  the  complete  sample  is 
not  available  since  the  values  associated  with  sample  ob¬ 
servations  greater  than  the  censoring  point  are  unobser¬ 
vable.  In  such  a  situation,  one  still  might  desire  to 
conduct  a  "Kolomogorov-Smirnov  type"  test  over  only  -he 
ordered  uncensored  sample  observations.  Such  a  modified 
Kolomogorov-Smirnov  test  is  derived  herein.  To  the  know¬ 
ledge  of  the  author,  this  test  has  not  been  previously 
available . 

The  modified  Kolomogorov-Smirnov  test  is  proved  to 
be  distribution  free.  Furthermore,  a  computational  for¬ 
mulation  is  presented  for  calculating  significance  levels 
and  the  significance  levels  are  tabulated  as  a  function 
of  sample  size  and  critical  value. 
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Proofs  and  derivations  contained  herein  do  not  speci¬ 
fically  deal  with  the  usual  problems  with  events  of  prob¬ 
ability  zero,  however  they  can  readily  be  modified  to 
include  such  events.  All  computer  work  performed  in 
connection  with  this  paper  was  conducted  at  the  United 
States  Naval  Postgraduate  School  on  an  IBM  360  computer. 

The  following  listing  constitutes  the  description 
and/or  definition  of  notation  utilized  herein: 


Notation 


Description 


n 

F 

f 

a 

n 

d,D 
D 


f,n 


vv 


Cumulative  distribution  function  of 
a  random  sample  of  size  n. 

Hypothesized  distribution  function. 

Number  of  observations  over  which  the 
modified  test  is  run. 

Level  of  test. 

Sample  size. 

Critical  values. 

Critical  value  associated  with  a  test 
run  over  the  first  f  ordered  observation 
from  sample  size  n. 

-<x  Ordered  observed  random  sample  from  dis- 
n  r 


tribution  F. 


Pf,n(D)  =  p  (  SUP  |  Sn(x)  -  F(x)  |  <  Df>n) 


x<xf 
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II.  KOLOMOGOROV- SMIRNOV  TEST 


Koloraogorov  established  that  the  distribution  of  the 
statistic 

SUP  |  S  (x)  -  F(x)  | 
x  n 

is  independent  of  the  parent  population  distribution  F  if 
F  is  continuous,  and  he  derived  its  limiting  distribution. 
Massey  [3]  and  Miller  [4]  present  methods  by  which  signif¬ 
icance  level  a  can  be  computed  for  a  given  critical  value 
d  such  that 

P(  SUP  |  S  (x)  -  F(x)  |  >  d  )  =  a. 
x  n 

This  relation  between  significance  level  versus  critical 
value  and  sample  size  is  the  basis  for  applying  the 
Kolomogorov- Smirnov  test.  Further  information  on  the  der¬ 
ivation,  tabulation  and  use  of  the  test  is  contained  in 
References  [1],  [2) ,  [3]  and  [4]. 

The  essence  of  the  Kolomogorov-Smirnov  test  is  that, 
for  a  sample  distribution  function  (Sn)  and  a  continuous 
parent  population  distribution  function  (F) ,  the  statistic 

SUP  I  Sn  -  F  I 

is  independent  of  the  distribution  of  the  parent  population. 
Thus,  given  that  the  population  has  distribution  F,  the 
probability  that  the  maximum  absolute  difference  between 
F  and  the  sample  distribution  will  exceed  a  -necified 
critical  value  is  dependent  only  upon  the  sample  size  and 
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the  critical  value  specified.  The  test  itself  then  is  sim¬ 
ple  to  conduct  since  it  entails  only  the  determination  of 
this  maximum  difference  and  whether  it  is  less  than  the 
specified  critical  value  Dn>  Furthermore,  as  stated  by 
Kendall  and  Stuart  (1,  pg  4S7)  "we  may  reverse  the  pro¬ 
cedure  of  testing  for  fit  and  use  Dn  to  set  confidence 
limits  for  a  (continuous)  distribution  function  as  a 
whole . " 

The  Kolomogorov-Smirncv  test  is  thus  a  simple  method 
for  either  testing  goodness -of -fit  or  establishing  con¬ 
fidence  limits  for  a  distribution  function  from  a  sample 
when  a  continuous  parent  population  distribution  is  hy¬ 
pothesized. 


III.  EXISTENCE  OF  THE  MODIFIED  KOLOMOGOROV- SMIRNOV  TEST 


The  Kolomogorov-Smirnov  goodness  of  fit  test  establishes 
a  band  t  d  such  that  the  probability  is  (1-a)  that  the 
true  distribution  function  F  lies  entirely  within  this  band, 

[1 ] .  That  is , 

P(  SUP  |  S  (x)  -  F(x)  |  >  d  )  -  a, 
x  n 

where  a  is  the  probability  that  the  test  rejects  the  hypoth¬ 
esis  that  F  is  the  distribution  of  X,  given  F  is  the  distri¬ 
bution  of  X  and  where  d  is  the  critical  value  for  test  size 
a.  Let  this  test  be  denoted  by  T.  Then  T  rejects  iff 

SUP  |  S  (x)  -  F(x)  |  >  d  for  some  x. 
x  n 

The  modified  K'ol omo go ro v - Sr.i rno v  test  proposed  herein 
is  to  apply  the  Kolomogorov-Smirnov  test  using  d*  for  crit¬ 
ical  value  and  applying  the  test  only  to  the  first  f  order 
statistics  to  yield  a  significance  level  a.  That  is, 

P(  SUP  |  S  (x)  -  F(x)  |  >  d*  )  -  a. 
x<xf  n 

Let  this  test  be  denoted  by  T*. 

Let  A  denote  the  event  that  rejection  occurs  for  some 
x^,  i  <  f  when  using  test  T,  given  that  test  T  rejects.  Then, 
with  each  test  using  critical  value  d*, 

P(T*  rejects)  =  P(T  rejects)  P(rejection  is  in  first  f  order 

statistics/rejection  occurs) 

=  P(T  rejects)  P(A)  <  P(T  rejects)  =  a. 
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However,  P(T  rejects)  is  a  continuous  monotone  de¬ 
creasing  function  of  d.  Therefore,  for  each  d  there  is  a 
d*  (d*<d)  such  that 

P(T  rejects  using  d)  =  P(T  rejects  using  d*)  P(A) 

=  P(T*  rejects  using  d*) 

which  establishes  the  existence  of  the  test  T* . 
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IV.  PROOF  THAT  THE  MODIFIED  KOLOMOGQROV- SMIRNOV  TEST  IS 
DISTRIBUTION  FREE 

Let  Y£ ,  ^2’*’",Yn  1)6  an  or<ierec*  random  sample  from  a 
continuous  distribution  F.  Define 

W  =  SUP  1  S  (y)  -  F(y)  | 

V<J{ 

where  n*Sn(y)  =  max  {k:  Y^  <  y}.  Let 

X£  =  F(Y£)  which  may  be  written  "X£(Y)M 

and 

W*  =  SUP  I  S*(x)  -  x  I  . 
x<X£  n 

Then  X£ ,  X-,,---,Xn  is  (almost  surely)  an  ordered  sample  from 
the  uniform  distribution  over  the  interval  (0,1). 

However, 

W  *  SUP  |  S  fy)  -  F(y)  j 

y$vf 

=  SUP  i  I  max  (k:  F(Y,  )  <  F(y)}  -  n  F(y)  | 
y-Yf 

*  SUP  i-  j  max  (k:  F(Y.)  <  F(y)}  -  n  F(y)  ] 

{y'.F(y)<F(Y£)}  n 

*  SUP  J-  |  max  {k:  X.  <  X(y)}  -  n  X(y)  | 
{y:X(y)<Xf}  n 

=  SUP  -  1  max  {k:  X.  <  x)  -  n  x  | 
x<X£  n  k  * 

*  SUP  I  S*(x)  -  x  I 
x<Xf  n 

=  W*  . 
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Thus  W  ■  W*  and  it  follows  that  for  any  critical  value  D 
P  (W  >  D)  =  P  (W*  >  D)  . 

Since  W*  has  a  distribution  not  depending  upon  F,  it  follows 
that  the  test  is  distribution  free. 
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V.  DERIVATION  OF  CRITICAL  VALUES  (Dr  J 

v  i  .n-' 


The  significance  level,  (D) ,  associated  with  a 

r  ,n 

given  critical  value,  n,  can  be  calculated  by  the  fol¬ 
lowing  procedure.  This  procedure  was  motivated  by,  and  is 
an  analytical  generalization  of  the  procedure  presented  by 
Massey  [3]  to  calculate  Kol omo go rov- Smirnov  critical  values. 

Since  it  has  been  shown  in  Section  IV  that  P-  (D)  is 

f  ,nv 

independent  of  F  provided  only  that  F  is  continuous,  it  is 
sufficient  to  consider  only  the  case 

f 

0  if  x  <  0 

F(x)  M  x  if  0  <  x  <  1 
1  if  x  >  1. 


Divide  the  interval  (0,1)  into  n  parts  by  the  points 

1/n,  2/n, - ,(n-l)/n.  The  step  function  Sn  rises  by  jumps 

of  exactly  1/n.  Thus,  in  order  to  be  inside  the  band 
F(x)  ±  k/n  at  x  =  i/n,  Sn(i/n)  must  be  one  of  the  lattice 

points  whose  ordinates  are  (i-k+l)/n,  (i-k+2)/n, - ,(i+k-l)/n. 

Let  be  an  n  dimensional  vector  of  non-negative  integers 


(ol,i'  °Z ,  i '  a3,i'"",an,i) 


such  that 


J-l 

Suppose  that  the  step  function  Sn  stays  inside  the  band  by 

means  of  a.  .  of  the  observations  from  F  falling  within  the 
3  t  * 
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interval  ((j-l)/n,  j/n) ,  j  ■  1,  2, — ,n.  Under  H6 ,  the 
probability  of  this  happening  is  given  by  the  multinomial 
law  as 


p(a 


1  *  i  ’ 


■Vi5 


n! 


alfi!»  a2 , iT 


a  rr 

n.i 


id 


•La-  • 

J*1  1 »i 


n 


3  =  1 


a  •  •  I 
3.1 


n ! 

n 

n 


Thus  the  probability  of  the  step  function  staying  within  the 
band  F  ±  is  given  by 

t  *  n 


n|_  =  n!_  y*  1 
n  ~  n  Z_,_n 
n  n  i  Tfa.  .  ! 

j=l  J*1 


where  the  summation  is  over  all  i  for  which  a.  is  associated 

1  t 

with  Sn  within  the  band.  There  exists  a  one-to-one  corre¬ 
spondence  between  {ou}  and  the  paths  of  SR. 

Define  a  =  (oij ,  , - ,  where  the  elements  of  a 

represent  all  paths  of  Sn-  Each  element  of  a  represents 
either  a  path  for  which  Sn(x)  remains  entirely  within  the 
band  for  x  <  x^  or  a  path  for  which  Sn(x)  does  not  remain  en 
tirely  within  the  band  for  x  <  x^. 

Let  I  =  (a-:  S  fx)  remains  entirely  within  the  band 
i  n 

for  x  <  X£}.  Then  by  the  multinomial  law 

P(  SUP  I  S„(x)  -  X  I  <  D  )  -  1  -  • 

Consider  all  possible  values  of  ^  (that  is  ^  ^  =  0,  1, 
---,n).  Then  either 
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<a>  “l,k  J  f 
or 

(t>)  a1>k<f 

and  one  of  the  following  mutually  exclusive  cases  must  hold 
(refer  to  Figure  1). 

All.  if  ai  k  -  f  an<i  Sn(x)  as  entirely  within  the 
band  for  x  <  then  ot^el  regardless  of  the 
values  of  k - ctn  k-  The  contribution  of 

“k  t0  Pf,n(D)  is 


where  the  sum  is  over  all  a.  ,  such  that  a.  v= 

J  f K  J " *  J  >K 

n  ‘  al ,k ' 

A21.  if  ai  k  -  f  snCx)  *s  not  entirely  within  the 

band  for  x  <  x^,  then  regardless  of  the  value 

of  ct 2  k, - ,  °n  k  and  therefore  does  not  con¬ 

tribute  to  the  sum  which  composes  n(D) • 

Bll.  if  a.  ,  <  f  and  S  (x)  is  entirely  within  the  band 
1  ,k  nv 

for  x  <  x  ,  then  whether  avel  will  depend  upon 
al,k  K 

<*2  k, ,  an  k  and  the  contribution  of  to 

Pf  n(D)  is  dependent  upon  a2  k ’  a3  k’  — *  an  k‘ 

B21.  if  a,  ,  <  f  and  S  fx)  is  not  entirely  within  the 
1 ,  k  n 

band  for  x  <  x  ,  then  ot.^I  regardless  of  a7  .  , 
al,k  k 

Oj  k,  *"',otn  k  anc*  therefore  «k  does  not  contri¬ 
bute  to  the  sum  which  composes  P^  n(D). 
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Consider  next  ak  -  (o^  k,  a ^  — »  an  suc^  that 


Oj  k=7Bll.  Then  either 


(a)  a1>k  +  a2,k  -  f 


or 


(b)  al,k  +  a2,k  <  f 

and  one  of  the  following  mutually  exclusive  cases  must  hold 
(refer  to  Figure  1) . 

A12.  if  “i  k  +  a2  k  ■  f  and  ^ntx)  is  entirely  within 
the  band  for  x  <  x^,  then  ct^el  regardless  of  the 

xn,k 

tion  of  ak  to  n(D)  is 


A22. 


B12 


,  a_  !,  and  the  contribu- 


n!_  1  y  _ 1 _ 

Rn  a2 ,k '  l— j  a3,k!  an,k 


n 


where  the  sum  is  over  all  a-  ,  such  that  a.  ,  * 

J  ,k  j-j  j 


n  -  a. 


l,k  2  ,k 

if  “l  k  +  a2  k  •  f  and  ^n(x)  xs  not  entirely  with¬ 
in  the  band  for  x  <  x^,  then  cxj, ^ I  regardless  of 

dj  k,  - ,  an  k  and  »k  does  not  contribute  to  the 

sum  which  composes  n(D). 


if  “l ,k  *  a2,k 


<  f  and  S  (x)  is  entirely  within 


the  band  for  x  <  x  .  ,  then  whether  a,  el 

*  °l,k  a2,k  k 

will  depend  upon  a  3  k ,  k ,  an  k  and  the  con¬ 

tribution  of  ak  to  r(D)  is  dependent  upon 


x3  ,k ' 


xn  ,k  ’ 
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B22.  if  ^  k  <  f  and  sn(x)  is  not  entirely 

within  the  band  for  x  <  „  ,  then 

‘  al,k  +  a2,k 

and  does  not  contribute  to  the  sum  which 
composes  Pf  n(D) • 

Consider  next  =  (o^  k,  02  k» - »an  fc)  such  that 

^  Bll  and  02  k  .  Continue  this  procedure  until 

the  contribution  from  each  ai,  iel,  to  n(D)  is  obtained. 
Then 


(1)  P£  n(D)  =  the  sum  over  all  iel  of  the  contribu¬ 
tions  to  P^  ..(D)  from  a. 

I  )U  X 


,  21  r  y  1  y  1 

_n  I  L—^t  a,  .  !  /  .a.,  .  ! - a„  .  ! 

La1>k=^All  1,3  ^  2  O  n>J 

V  1  V  1 

+  L,  °l,jla2  fj!  ,  j  '  an ,  j  ’ 


a2  .k"2^12 


+  -  -  - 


z 


Trr 


an-2,j=^Al,n-2  M'  n'2 ,  j  * 

- - r  .  Z 

an-l,j!an,j-  Vl.j^Al.n-l 


n 


where  the  inner  sums  are  over  all  a.  .  such  that  .  a-  •  a  n 

i>j  i>j 

Let  U(k,r)  g  /  ~  t  ;Zr>~T  over  a  such  that  a ^  »  r. 

Then  U(k,r)  satisfies  the  difference  equation 
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m 


VI.  COMPUTATIONAL  FORMULATION  FOR  CALCULATION  OF  signifi¬ 
cance  levels 


The  foregoing  derivation  can  be  utilized  to  calculate 
the  significance  level  associated  with  a  given  critical 
value  for  the  modified  Kolomogorov-Smirnov  test.  However, 
the  procedure  would  be  cumbersome  and  not  amenable  to  com¬ 
putation.  A  more  tractible  computational  extension  is  dis¬ 
cussed  in  what  follows. 

Massey  [3]  has  derived  the  set  of  2k-l  difference  equa¬ 


tions 


with 


Uj  (m+1)  =  ^  Uh(m)  *  5  =  l,2,---,2k-l 

h=l 

U^Cm)  *0ifh>m  +  k 
U^O)  =  0  for  1  f  k 
Uk(0)  =  1  for  i  =  k 


which  yields 

Pn(k/^  )  .  21  Uk(n) 

n 

for  the  probability  that  the  sample  distribution  function 
(Sn)  stays  entirely  within  the  band  F  ±  k/n. 

Referring  to  the  (0,1)  interval  divided  into  n  equal 
parts  and  indexed  with  1  through  n,  the  (m)  values  repre¬ 
sent  values  assigned  to  the  lattice  points  within  the  band 
F  ±  k/n  (refer  to  Figure  2) . 

The  index  m  refers  to  the  ordinate  index  of  the  lat¬ 
tice  point.  Thus,  the  values  for  the  lattice  points  with 
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ordinate  (m+1)  depend  only  upon  the  values  of  lattice  points 
within  the  band  with  ordinate  m  and  upon  the  critical  value 
(k/n)  and  sample  size  (n) . 

U^fn)  then  represents  the  value  associated  with  paths 
of  Sn  which  remain  entirely  within  the  band  F  ±  k/n  and  pass 
through  lattice  point  (n,n).  Consequently  Uj,  (n)  •  (n! /n11)  is 
the  probability  that  will  remain  entirely  within  the  band 
F  ±  k/n. 

Massey's  approach  can  be  modified  to  provide  similar 
difference  equations  for  the  calculation  of  the  significance 
level  associated  with  critical  value  (k/n) ,  number  of  un¬ 
censored  failures  (f) ,  and  sample  size  (n)  for  the  modified 
Kolomogorov-Smirnov  test.  The  required  modification  is  to 
replace  the  requirement  that  ”bn  remain  entirely  within 
F  ±  k/n"  with  the  requirement  that  ”Sn  remain  entirely  with- 
in  F  i  k/n  through  the  f  ordered  observation." 

The  set  of  difference  equations  which  results  from  this 
modification  is 

r 

Vm+1)  =  Z  u?Wr  uh(m)  ;  ®  =  ; 

h=l  J  '  u •  n 

where  the  upper  limit  on  the  sum  is  given  by 

1n-m+k-l  if  f  <  F  ±  k/n 

j+1  if  f  >  F  +  k/n  (refer  to  Figure  3) . 

Additional  computational  efficiency  can  be  obtained  by 
recalling  that  the  IT  (m)  values  for  each  lattice  point  re¬ 
sults  from  the  cu  components  which  determine  specific  paths 
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m 

for  S  .  Thus,  if  .  £.  a.  >  f  then  the  first  f  ordered  ob- 
servations  remain  within  the  band  F  ±  k/n  regardless  of  ou  , 
i  »  m+1,  — ,  n.  Consequently,  the  (m)  values  for  these 
lattice  points  can  be  relabled  as  Z. (m)  and  the  difference 
equations  summed  only  over  the  lattice  points  which  repre¬ 
sent  paths  for  which  it  is  undetermined  whether  Sn  remains 
within  F  ±  k/n  for  the  first  f  ordered  observations.  Ref¬ 
erencing  Figure  4,  it  may  be  seen  that  this  yields  the  equa¬ 
tions 

ym*l)  -  Ic  Uh(m) 

y 

V"*1)  '  fcc.  (jvr-hyr  «hW 

where  represents  the  circled  lattice  points  in  Figure  4 
having  abscissa  values  less  than  or  equal  to  j . 

Consider  the  set  of  difference  equations 

j 

OVUP  (i  +  1 ,  j  )  =  £  ^TpK)T  OVUP(i.i)  ;  j  =  0 ,1 , 
h=0 

with  initial  conditions 

OVUP (0,0)  =  1 
OVUP(O.j)  =  0  if  j  t  0. 

OVUP(i,j)  is  an  array  which  represents  values  associated 
with  path  segments  for  which  Sn  traverses  i  lattice  points 
to  the  right  while  increasing  in  abscissa  valt-’  by  j  lattice 
points.  Consequently,  the  (m)  values  can  b.  translated  to 


21 


values  at  lattice  point  (n,n)  by  multiplying  each  Z^ (m) 
value  by  OVUPfn-m,  n-j-m+f-1).  The  value  of  Uk(n)  is  then 
the  sum  of  these  translated  (m)  values.  That  is 


Uj.Cn)  =  Y.  ZjW  OVUP  (n-m ,  n-j-m+f-l) 
all  z 

and 

P(F-k/n  <  Sn  <  F+k/n)  =  Uk(n)  Si 


yields  the  significance  level  associated  with  the  critical 
value  k/n,  k  an  integer,  for  the  modified  Kolomogorov- 
Smirnov  test. 

This  computational  procedure  is  specifically  applicable 
to  critical  values  of  k/n,  k  an  integer.  However,  the  pro¬ 
cedure  can  readily  be  adapted  to  critical  values  of  k/fm-n) 
with  k  and  m  integers  by  dividing  the  (0,1)  interval  into 
m*n  parts  vice  n  parts.  Moreover,  the  significance  level 
associated  with  critical  values  not  specifically  calculated 
can  be  approximated  by  interpolation  between  critical  values 
for  which  the  significance  levels  were  calculated. 

This  latter  compuational  formulation  is  the  basis  of 
the  computer  program  presented  as  Appendix  A.  The  signifi¬ 
cance  levels  as  calculated  from  the  program  in  Appendix  A 
are  presented  as  Appendix  B  for  all  combinations  of  the  fol¬ 
lowing  parameters: 


n  = 

5, 

10,  15,  20, 

25,  30 

k  = 

1, 

2,3,  4,  5, 

6,  7,  8,  9,  10 

f  = 

1, 

2,  ---,  n. 
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Figure  2.  Massey's  Procedure. 
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Figute  3.  Modified  Procedure. 
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1 


2 


3 


4 


Figure  4 


Modified  Procedure  Using  Translation. 
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VII.  VERIFICATION  OF  SIGNIFICANCE  LEVEL  COMPUTATIONS 


In  order  to  verify  the  correctness  of  the  computer  pro¬ 
gram,  a  computer  simulation  was  conducted.  This  simulation 
was  based  upon  a  population  distribution  which  was  uniform 
over  the  interval  (0,1).  The  simulation  was  run  for  sam¬ 
ple  sizes  (n)  of  S  and  10,  with  critical  value  (k/n)  of 
0.40,  and  3C0t  replications. 

The  computer  program  for  the  simulation  is  listed  in 
Appendix  C.  The  significance  levels  resulting  from  the 
simulations  and  the  corresponding  significance  levels  from 
Appendix  B  are  shown  in  Table  I.  It  appears  that  the  simu¬ 
lated  values  and  the  calculated  values  are  in  agreement. 

This  contention  tnat  the  computed  values  are  (approximately) 
correct  i -  further  supported  by  comparing  them  with  the 
values  calculated  by  Massey  [3].  These  values  are  shown  in 
Table  II. 

In  view  of  the  foregoing,  it  is  concluded  that  the 
calculated  significance  levels  (Appendix  B)  and  the  computer 
program  from  which  they  were  calculated  (Appendix  A)  are 
accurate  and  contain  no  significant  errors. 
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TABLE  I 


CRIT’;  \L 
VALUE 

« 

1 

t 

» 

1 

n  J 

#  OBSERVATIONS 
(£) 

!  SIGNIFICANCE  LEVEL 

■ttvwuarei] 

.40 

\ 

1 

i 

5  ' 

i 

1 

1  .9233 

t 

.92224 

f 

! 

2 

•  .8663 

1 

.87104 

f 

t 

1 

3 

1  .7867 

» 

.78752 

f 

1 

t 

4 

'  .7277 

1 

.72960 

1 

t 

f 

S 

1  .6923 

.69120 

.40 

f 

10  ' 
f 

1 

*  .9937 

1 

.99395 

I 

1 

I 

1 

2 

'  .9883 

» 

.98614 

f 

I 

I 

3 

’  .9803 

» 

.97906 

1 

1 

« 

4 

'  .9740 

» 

.97392 

» 

1 

r 

5 

'  .9677 

1 

.96953 

1 

i 

i 

6 

'  .9620 

t 

.96331 

1 

• 

t 

7 

'  .9560 

« 

.95596 

« 

f 

t 

8 

'  .9463 

» 

.94895 

1 

1 

9 

'  .9413 

f 

.94365 

1 

i 

10 

1  .9387 

.94101 
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TABLE  II 


SAMPLE 

SIZE  fn) 

CRITICAL 

VALUE 

.  MASSEY 

APPENDIX  B 

5 

.20 

»  .0384  ' 

.03840 

.40 

'  .6521* 

.69120 

.60 

'  .9699  * 

.96992 

.80 

'  .99935  ' 

.99936 

10 

.10 

,  .0004  , 

.00036 

.20 

,  .2513  , 

.25128 

.30 

f  .7331*  , 

.72946 

.40 

,  .9410 

.94101 

.50 

,  .9922  , 

.99222 

.60 

,  .9994  , 

.99943 

20 

.10 

.0238 

.02374 

.15 

.2955 

.29553 

.20 

.6473 

.64728 

.25 

.8624 

.86237 

.30 

.9569 

.95693 

.35 

.9892 

.98924 

.40 

.9979 

.99787 

.45 

.9997 

.99967 

25 

.20 

•  .7637  » 

.76367 

.24 

'  .9057  ' 

.90564 

.28 

•  .9683  ' 

.96832 

.32 

'  .9911  * 

.99109 

.36 

’  .9979 

.99791 

30 

.1667 

,  .6629  , 

.66289 

.2000 

,  .8420  , 

.84202 

.2333 

,  .9359  , 

.93587 

.2667 

,  .9774 

.97744 

.3000 

,  .9931 

.99314 

•significance  difference  exists  between  Massey's  results  and 
results  within  Appendix  B.  Further  study  has  indicated  thit 
the  results  of  Appendix  B  are  cor  ect. 
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VIII.  APPLICATIONS  OF  MODIFIED  KOLGMOGOROV- SMIRNOV  TEST 


The  modified  Kolomogorov- Smirnov  test  is  essentially 
a  Kolomogorov- Smirnov  test  run  over  only  the  first  f 
ordered  observations.  Therefore,  the  modified  test  is  ap¬ 
plicable  to  data  for  which  the  Kolomogorov-Smirnov  test 
would  be  applicable  except  that  the  data  is  censored  at 
some  predetermined  number  of  ordered  observations  or,  for 
some  other  reason,  it  is  undesirable  or  impossible  to  con¬ 
sider  datum  beyond  the  specified  .number  of  observations. 

When  the  modified  test  uses  all  n  ordered  observations, 
the  modified  Kolomogorov-Smirnov  test  is  identical  to  the 
Kolomogorov-Smirnov  test. 

As  with  the  Kolomogorov-Smirnov  test,  the  modified 
test  can  be  used  as  a  goodness  of  fit  test  if  the  (contin¬ 
uous)  distribution  function  (F)  is  completely  hypothesized. 
Furthermore,  just  as  the  probability  statement  for  the 
Kolomogorov-Smirnov  test  can  be  inverted  to  yield  a  method 
of  setting  confidence  limits  (1,  pg  457),  the  probability 
statement  for  the  modified  Kolomogorov-Smirnov  test  can  be 
inverted  to  yield  a  method  of  setting  confidence  limits 
utilizing  only  the  first  f  ordered  sample  observations. 

This  attribute  of  the  modified  test  can  be  useful  in  cen¬ 
sored  life  testing  situations  where  data  is  censored  at  some 
predetermined  number  of  ordered  observations. 
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IX.  WORK  REMAINING  TO  BE  DONE 

Areas  wherein  it  appears  prudent  to  direct  further  in¬ 
vestigation  of  the  modified  Kolomogorov-Smirnov  test  pre¬ 
sented  herein  are: 

(a)  evaluation  of  the  power  of  the  modified  test. 

(b)  comparison  of  the  performance  of  the  modified 
test  against  other  test  procedures  presented  in  the  liter¬ 
ature  . 

(c)  restructure  the  test  to  provide  critical  value 
versus  significance  level  value  for  censoring  at  a  pre¬ 
determined  point  instead  of  a  predetermined  number  of  ob¬ 
servations  . 

It  is  conjectured  that  item  (c)  can  be  accomplished 
by  utilizing  the  difference  equations  presented  by  Massey 
[3]  except  carrying  the  summation  over  lattice  points  with¬ 
in  the  band  only  to  the  censor  point  and  then  translating 
these  values  to  the  n/n  lattice  point  by  use  of  the 
OVUP(i,j)  array  presented  in  Section  VI  of  this  paper. 
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X.  SUMMARY 


The  Kolomogorov-Smirnov  test  is  a  well  documented 
procedure  for  testing  goodness  of  fit  between  a  hypothe¬ 
sized  distribution  and  an  unknown  distribution  by  uti¬ 
lizing  a  random  sample  drawn  from  the  unknown  distribution. 
The  Kolomogorov-Smirnov  test  can  be  utilized  to  establish 
confidence  limits  for  the  hypothesized  distribution  func¬ 
tion  as  a  v/hole.  The  significance  levels  associated  with 
given  critical  values  are  well  tabulated  and  procedures 
for  their  calculations  have  been  published  in  the  litera¬ 
ture  . 

A  derivation  and  computational  formulation  for  a  modi¬ 
fied  Kolomogorov-Smirnov  test  has  been  presented.  It  ex¬ 
tends  the  hypothesis  testing  and  confidence  limits  advantages 
of  the  Kolomogorov-Smirnov  test  to  one  for  censored  data. 

The  modified  test  is  essentially  a  Kolomogorov-Smirnov  test 
run  only  over  the  first  f  ordered  sample  observations.  A 
listing  of  the  computer  program  used  in  the  calculations 
of  significance  levels  of  the  modified  test  for  given 
critical  values  is  presented  as  Appendix  A.  The  resulting 
significance  levels  for  specified  parameter  values  are 
given  in  Appendix  B. 
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APPENDIX  A:  COMPUTER  PROGRAM  FOR  CALCULATION  OF  SIGNIFICANCE 

Levels  - - 
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APPENDIX  B:  CALCULATED  SIGNIFICANCE  LEVELS 


(n  -  sample  size,  f  *  number  of  observations,  critical  value  *  k/n) 
n  »  5 


1 

2 

6 

3 

7 

4 

8  9 

5 

10 

1  ’ 

1 

0.67232 

0.92224 

0.98976 

0.99967 

0.99999 

1 

2  , 

0.28000 

0.87104 

0.98496 

0.99968 

1.00000 

3  ' 

_  1 

0.12160 

0.78752 

0.98496 

0.99968 

1.00000 

» 

4  , 

0.05760 

0.72960 

0.97824 

0.99968 

1.00000 

5  ' 

0.03840 

0.69120 

0.96992 

0.99936 

1.00000 

n  *  10 


1  '  0.65132  0.89262  0.97175  0.99395  0.99902 

'  0.99989  0.99999  1.00000  1.00000  1.00000 


2  '  0.25320  0.81192  0.94152  0.98614  0.99771 

'  0.99977  0.99999  1.00000  1.00000  1.00000 


3  ’  0.09911  0.68126  0.91515  0.97906  0.99668 

'  0.99972  0.99999  1.00000  1.00000  1.00000 


4  ’  0.03914  0.55947  0.88112  0.97392  0.99618 

'  0.99971  0.99999  1.00000  1.00000  1.00000 


5  ’  0.01564  0.46168  0.83988  0.96953  0.99611 

’  0.99971  0.99999  1.00000  1.00000  1.00000 


6  '  0.00635  0.38556  0.80282  0.96331  0.99596 

'  0.99971  0.99999  1.00000  1.00000  1.00000 


7  ,  0.00265  0.32827  0.77438  0.95596  0.99516 

,  0.99970  0.99999  1.00000  1.00000  1.00000 


8  ,  0.0011S  0.28842  0.75368  0.94895  0.99391 

,  0.99963  0.99999  1.00000  1.00000  1.00000 


9 


0.00054  0.26563  0.73821  0 

0.99951  0.99998  i. 00000 


.94368  0.99279 

1.00000  1.00000 


10 


0.00036  0.25128  0.72946  0.94101  0.99222 


0.99943  0.99998  1.00000  1.00000  1.00000 
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n  »  15 


10 


0.64473  0.88310  0.96481  0.99045  0.99771 

0.99952  0.99991  0.99998  0.99999  0.99999 


0.24576  0.79514  0.92578  0.97675  0.99379 

0.99862  0.99975  0.99996  0.99999  0.99999 


0.09394  0.65514 

0.99750  0 


0.88982  0.96212  0.98918 

.99955  0.99993  0.99998  0.99999 


0.03602 

0. 


0. 

99640 


52460 

0 


0. 

99937 


84326 

0. 


0.94813 
99992  0. 


0.98457 

99998  0.99999 


0.01386 

0. 


0. 

99549 


41916 

0 


0. 

.99925 


78520 

0 


0.93326 
99991  0 


0. 

.99998 


98045 

0. 


99999 

99999 


0.00536 

0. 


0  . 

99486 


33562 

0 


0. 

99919 


72783 

0. 


0.91412 
99991  0 


0. 

,99998 


97684 

0. 


0.00208 

0. 


0. 

99450 


26985 

0 


0. 

.99918 


67530 

0. 


0. 

99991 


89308 

0. 


0. 

99999 


97277 

0. 


99999 

99999 


8 

9 

10 

11 

12 

13 

14 

15 


0.00082 

0 


0. 

.99413 


21322 

0. 


0 

99917 


.62879 

0 


0. 

.99991 


87270 

0 


0 

.99998 


.96810 

0 


0.00032 

0, 


99341 


.17779 

0. 


0 

99914 


58861 

0 


0 

.99991 


.85455 

0. 


0 

99999 


,96331 

0. 


99999 

99999 


0.00013 

0. 


0 

99250 


,14631 

0 


0 

99905 


.55494 

0 


0. 

,99991 


83946 

0 


0 

,99999 


95870 

0 


0.00005 

0. 


0 

99140 


,12206 

0, 


0 

99888 


52806 

0 


0 

,99990 


82755 

0 


0 

.99999 


.95438 

0. 


99999 

99999 


0.00002 

0. 


0 

990  35 


10388 

0. 


0 

99869 


50827 

0 


0 

,99988 


81793 

0 


0 

,99999 


.95064 

0 


0.00001 

0. 


0 

98953 


09125 

0 


0 

,99852 


,49415 

0 


0 

,99986 


81038 

0 


0 

.99999 


.94777 

0. 


99999 

00000 


0.00000 

0, 


0 

98902 


,08404 

0 


0 

,99841 


48377 

0, 


0 

99984 


80523 

0, 


0 

99999 


,94594 

1 


0.00000 

0, 


0 

98882 


,07950 

0 


0 

,99837 


,47795 

0 


0 

,99983 


80275 

0 
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,99999 


,94517 

1. 


00000 
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f 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 


0.641S1  0.87842  0.96123  0.98846  0.99681 

0.99919  0.99980  0.99994  0.99997  0.99998 

0.24227  0.78722  0.91799  0.97155  0.99112 

0 . 99751  0.99937  0.99985  0.99996  0.99998 

0.09163  0.64328  0.87783  0.95298  0.98398 

0.99520  0.99874  0.99971  0.99993  0.99997 

0.03471  0.50956  0.82612  0.93455  0.97627 

0.99253  0.99798  0.999S3  0.99990  0.99997 

0.01317  0.40200  0.76163  0.91448  0.96853 

0.98975  0.99718  0.99935  0.99987  0.99996 

0.00501  0.31713  0.69734  0.88859  0.96080 

0.98708  0.99643  0.99919  0.99984  0.99996 

0.00191  0.25053  0.63757  0.85935  0.95180 

0.98462  0.99577  0.99906  0.99983  0.99996 

0.00073  0.19836  0.58334  0.82344  0.94128 

0.98215  0.99526  0.99398  0.99982  D.99?96 

0.00028  0.15748  0.53468  0.80048  0.92996 

0.97940  0.99485  0.99894  0.99982  0.99996 

0.00011  0.12544  0.49130  0.77337  0.91863 

0.97641  0.99443  0.99892  0.99982  0.99996 

0.00004  0.10032  0.45287  0.74859  0.90789 

0.97333  0.99392  0.99888  0.99982  0.99996 

0.00002  0.08063  0.41906  0.72646  0.89818 

0.97033  0.99329  0.99S80  0.99981  0.99990 

0.00001  0.06519  0.38964  0.70720  0.88976 

0.96751  0.99255  0.99867  0.99980  0.99996 

0.00000  0.05311  0.36443  0.69100  0.88268 

0.96488  0.99177  0.99850  0.99978  0.99996 

0.00000  0.04370  0.34340  0.67795  0.87680 


16 


0.96251  0.99101  0.99833 

0.00000  0.03646  0.32665  0 


0.99975  0.99996 

.66785  0.87184 


0.96049  0.99036  0.99816  0.99972  0.99996 


7 


3 


8 


4  5 


9 


10 


17  '  0.00000  0.03103  0.31434  0.65979  0.86785 

'  0.95890  0.98984  0.99803  0.99970  0.99996 


18  '  0.00000  0.02726  0.30SS8  0.65354  0.86493 

'  0.95780  0.98949  0.99794  0.99968  0.99996 


19  '  0.00000  0.02510  0.29914  0.64931  0.86312 

•  0.95716  0.98930  0.99789  0.99967  0.99996 


20  '  0.00000  0.02374  0.29553  0.64728  0.86237 

’  0.9S693  0.98924  0.99787  0.99967  0.99996 


n  ■  25 


1  '  0.63960  0.87563  0.95906  0.98719  0.99620 

'  0.99893  0.99970  0.99991  0.99996  0.99997 


2  '  0.24023  0.78260  0.91337  0.96830  0.98931 

'  0.99667  0.99903  0.99973  0.99991  0.99996 


3 


0.09031  0.63650  0.87087  0.94740  0.98052 

0.99343  0.99798  0.99943  0.99984  0.99994 


4  '  0.03399  0.50116  0.81639  0.92644  0.97079 

'  0.98954  0.99663  0.99902  0.99973  0.99992 


5  '  0.01280  0.39269  0.74856  0.90351  0.96075 

'  0.98528  0.99507  0.99853  0.99960  0.99989 


6  '  0.00483  0.30742  0.68088  0.87399  0.95043 

'  0.98088  0.99342  0.99801  0.99946  0.99985 


7  '  0.00182  0.24078  0.61785  0.84046  0.93829 

•  0.97649  0.99177  0.99748  0.99933  0.99983 


8  '  0.00069  0.18878  0.56049  0.80579  0.92397 

'  0.97181  0.99018  0.99699  0.99920  0.99980 


9 


0.00026  0.14822  0.50876  0.77166  0.90820 

0.96652  0.98864  0.99655  0.99910  0.99979 


10 


0.00010  0.11656  0.46231  0.73R93  0.89181 

0.96060  0.98704  0.99618  0.99903  0.99978 


i 

I 
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9S428 


09184 

0, 


0, 

98S32 


42071 

0, 


0. 

99584 


70806 
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0. 

99897 


87546 

0. 


99977 


0.00001 

0, 


0, 

94785 


07252 

0, 


0. 

98348 


38352 

0, 


0 

99550 


,67924 

0, 


0. 

99893 


85963 

0, 


99977 


0.00001 

0, 


0, 

94155 


05740 

0, 


0, 

98158 


35034 

0, 


0. 

99513 


65256 

0, 


0, 

99890 


84465 

0. 


99977 


0.00000 

0. 


0. 

93560 


04557 

0. 


0, 

97969 


32081 

0. 


0, 

99470 


62808 

0. 


0. 

99883 


83078 

0, 


99976 


0.00000 

0, 


0, 

93014 


03630 

0, 


0, 

97786 


29461 

0 


0, 

99423 


60582 

0, 


0, 

99874 


81818 

0, 


99975 


0.00000 

0, 


0. 

92528 


02903 
0  , 


0. 

97613 


27146 

0, 


0. 

99373 


58582 

0. 


0. 

99863 


80699 

0, 


99974 


0.00000 

0. 


0, 

92104 


02333 

0. 


0, 

97452 


25113 

0. 


0. 

99320 


56813 

0. 


0. 

99850 


79729 

0, 


99971 


0.00000 
0  , 


0 , 

91738 


01886 

0 


0, 

,97303 


23346 

0. 


0, 

992  70 


55283 

0. 


0. 

95836 


78911 

0. 
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0, 

91423 


01537 
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0, 

97171 


21833 

0, 


0, 

99224 
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0, 

99824 
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99966 


0.00000 

0, 


0, 

91153 


01265 

0, 


0 

97059 


.20572 

0, 


0, 

99184 


52969 

0. 


0. 

99812 
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0, 


99964 


0.00000 

0, 


0 
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0 
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0. 


0 
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0. 

99803 


77229 
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0. 
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0, 
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0, 
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0. 
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0. 
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0.00000 

0. 


0, 

90652 


00789 

0 


0. 

96861 
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0, 


0, 

99118 


51045 

0, 


0 

99793 


76598 

0. 


99959 


0.00000 

0. 


0, 

90587 


00726 

0, 


0 

96839 


,17918 

0, 


0, 

99111 


50713 

0. 


0. 

99792 


76435 

0, 


99959 


0.00000 

0. 


0, 

90S64 


0 

.96832 


,17702 

0, 


0, 

99109 


50553 

0. 


0. 

99791 


76367 

0. 


99959 
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0 .63833 
0. 


0 

9987S 


,87378 

0, 


0, 

99964 


9S760 

0, 


0, 

99990 


98633 

0. 


0, 

99997 


99S78 

0. 


99998 


0.23890 

0, 


0. 

99605 


779S8 

0, 


0, 

99877 


91030 

0, 


0, 

99964 


96611 
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0. 

99989 


98804 

0, 
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0. 


0, 

99212 
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0, 


0. 

99737 
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0, 

99919 
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0, 


0, 

99976 
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0. 


0, 

98732 


49579 

0. 


0. 

99552 
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0, 
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0. 

99956 
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0. 


0, 
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0. 
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0 
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0, 
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0, 


0. 
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0. 


0, 

99900 


94340 

0 


99971 


0.00177 

0, 


0 

97049 


23488 

0. 


0, 

98836 


60571 

0. 


0. 

99585 


82850 

0 


0, 

.99867 


92924 

0, 


99961 


0.00067 

0, 


0. 

96420 


18312 
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0 
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0. 
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0, 
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0.00025 

C, 
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0 
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,49348 
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0. 
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0 
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0. 

94886 
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0, 
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44566 

0. 


0 
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0 
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0. 


99933 
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0, 


0, 

94001 


08726 

0, 


0 

97717 


.40277 

0. 


0 

99190 


,68424 

0. 


0. 

99738 


85461 

0. 


99925 


0.00001 

0. 


0, 

93074 


06831 

0, 


0. 

97376 


36436 

0. 


0. 

99089 


65215 

0 


0, 

,99712 


83507 
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0. 


0, 
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0. 

97015 
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0, 

98983 
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0. 

99688 
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0, 

91203 
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0. 
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0 
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0 
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0. 

96273 
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0, 


0 
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,56766 

0, 


0. 

996  38 


78049 

0, 
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89444 
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95913 
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0. 

98638 


54332 

0. 


0. 
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99820 
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,01628 
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0, 

98411 
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0. 

99547 
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0. 

99514 


72252 

0 


20 


0.00000 

0. 


0. 

86659 


01029 

0, 


0, 
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APPENDIX  C:  COMPUTER  PROGRAM  FOR  VERIFICATION  OF  CALCULATED 

Significance  "Levels  - - 

ICNTII)  IS  TV**  NH**p*R  0<=  Pc  PL  !CA  T1 ONS  FOR  WHICH  THE  FIRST  I 
CPDtFFD  CBS c0 VAT  I  CMS  REMAIN!  WITHIN  THE  BAND  WHERE  F  IS 
THE  UtO,l>  01 STe 'BUTTON,  rv»</N  IS  THE  CRITICAL  VALUE,  AND 
N  IS  THE  SAV=LC  SIZE. 

01  MEN'S  TEN  X  ( 30  )  , T < 30 > , I CNT ( 30 ) 

DATA  IC NT /3 0*0 / 

MO  =  124R3 
10  *  37345 
KR  s  8*M0  +  3 
NREP  =  3000 
DO  550  N=5  *  10 , 5 
K  =  2*N/5 

CV  =  FLOAT(K)/FLOAT(N) 

WRIT':  (6,50)  CV 

50  FORMAT  (3X,*C?!T  VALUE  =‘,F6.4) 

DO  500  XKK=l.MRE° 

DC  2IC  K=1,N 
JR  =  IR»KF. 

R  a  0.5  +  eL04T ( I°)*2.328306F-10 
X(K)  =  R 
210  CONTINUE 

DC  240  L  = I « N 
T( L I  =  I. 01 
CO  230  K=I,N 

1=  ( X ( K )  •  CT  .  T ( L )  )  GO  TO  230 
KQ  =  K 

T(U  =  X(K| 

230  CONTINUE 

X(KO)  =  1.01 
240  CONTINUE 

DO  300  1=1, N 

ON  a  T  (  I  )  -  CLDAT(  !-U  /*LDAT(N) 

0N2  a  FLOAT(I)/cLnAT(N)  -  1(1) 

1?  (DM2  .ST.  DN  )  ON  =  ON 2 
If  (ON  . GT .  0 V  )  GO  TO  500 
ICNT(I)  =  TCNT(I)  +  1 
300  C/»\IT INUF 
500  CO  NT  INI  *c 

DO  550  K=1,K 

3P  =  cL DAT ( ICNT(K) )/=LOAT(NREP) 

Wo  IT'  (6.6001  K.PF 
6CG  FDRMiT  ( 5X, 13, C1C.4) 

ICNTII'  )  =  C 
550  CONTINUE 
ST  TP 
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